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Detailed Report 

1. Name of invention 
information input-output device 

2. Sphere of patent request 
(Claim 1) 

Claim 1 is concerning an information input-output device which has the following 
characteristics: photoelectron transformation elements corresponding to the pixel 
electrodes are arranged inside an active matrix display panel after connecting switched 
voltage to each pixel electrode in the matrix. Input of a pattern drawn by a light pen is 
accomplished by detecting light from the pen moving across a liquid crystal display panel 
with the photoelectron transformation elements. 

(Claim 2) 

Claim 2 is concerning the information input-output device in claim 1 where the 
display panel is a liquid crystal display. 

(Claim 3) 

Claim 3 is concerning the information input-output device in claim 1 where the 
photoelectron transformation elements are photo diodes. 

(Claim 4) 

Claim 4 is concerning the information input-output device in claim 1 where the 
switching is accomplished by thin film transistors formed on the cell substrate. 

(Claim 5) 

Claim 5 is concerning the information input-output device in claim 1 where the 
photoelectron transformation elements are connected to a voltage supply line which 
drives the switching. 

(Claim 6) 

Claim 6 is concerning the information input-output device in claim 1 where the 
beam from the light pen is in a narrow range of the visible spectrum. 

(Claim 7) 

Claim 7 is concerning the information input-output device in claim 1 where a 
filter which transmits only a select spectrum component from the light pen is arranged at 
the photoelectron transformation elements. 

3. Detailed explanation of invention 
(Technical field of this invention) 
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This invention is concerning information input-output device, which consists of 
an active matrix substrate with switching elements that corresponds to each pixel in the 
matrix. Especially, it is concerning a liquid crystal input output device which enables 
information input by a light pen. 

(Background of this invention) 

Recent demands in office and laboratory automation for input-output devices that 
bridge human and automatic machines have been increasing. To communicate 
information from machine to human, various display equipment such as LCD, CRT, 
LED, EL, PDP, and VFD are used. To communicate information from human to 
machine; keyboards, touch panels, graphic tablets, mouse, etc., are used in accordance 
with the type of information input - graphic input, etc. These are all one-way methods of 
communicating. However, light pens have been used for two-way communication. This 
combines photoelectron transformation elements called a light pen and a CRT. When the 
light pen gets close to the CRT screen, the CRT beam scans the position of the light pen, 
and the photoelectron transformation elements of the light pen detects light and outputs a 
pulse. By comparing the timing of this pulse and the polarized signal of the CRT, the 
position of the light pen is detected. This method makes graphical input easy. Someone 
who is not used to using a keyboard can operate a light pen in dialogue mode. On the 
other hand, electrical consumption is high, the equipment is big (deep), or the screen is 
curved - these are all Original problems with the CRT. 

(Object of this invention) 

This invention has solved these problems by combining photoelectron 
transformation elements in an LCD and combining it with a light-emission type light pen. 
Its object is to offer an input-output device with low electrical consumption which is thin 
and light and suitable for potable use. 

(Basic technology of this invention) 

To explaining the basic construction of this invention a color liquid crystal display 
panel is going to be explained first as one example of various display devices. A color 
liquid crystal panel consists of many pixel electrodes arranged in a matrix, a liquid crystal 
layer which modifies light in accordance with voltage applied to the pixels, and a color 
step that depends on the pixel arrangement. By applying picture image signals to each 
pixel depending on its color, it is possible to display an image containing neutral tints 
with color added and mixed according to the same principal as the color CRT. 

There are many modes of activating the liquid crystal panel such as twisted 
nematic (TN), guest host (GH), dynamic scattering mode (DSM), phase transition, etc. 
This invention can be applied to any of these. Especially, TN and GH give good results. 
For GH, black element are used, and it uses a so-called black shutter. Details of liquid 
crystal are discussed in "Basic and Application of Liquid Crystal Electronics" by Sasaki, 
published by Aum (1979), etc. 

In order to control each pixel individually, normally one of the next 3 methods is 

used. 

(1) simple matrix 
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Electrode stripes are set up on each of two substrates and these two substrates are pasted 
together so the electrodes are perpendicular. Normally, it is driven by a voltage averaging 
method and the line-select signal is applied to the line electrodes in order. A picture 
image signal is applied to the row electrodes simultaneously with the line selection signal. 
The crossing point of the line electrode and row electrode becomes a pixel, and the liquid 
crystal between two electrodes responds to the difference in electric potential between the 
electrodes. 

Liquid crystal is an element which responds to efficacy values so the number of 
lines cannot be increased much because of cross talk and dynamic range. In order to 
overcome these restrictions, the next two methods have been developed. 

(2) addition of nonlinear elements 

In this method, nonlinear elements such as varistor, MIM (metal/insulator/metal), or 
back-to-back diodes are added to each pixel, and cross talk is controlled by improving the 
threshold. 

(3) addition of switching elements (active matrix) 

In this method, switching transistors are added- to each pixel to drive them individually. 
Driving voltage is applied during a selection period, and charge is accumulated in a 
condenser where it remains during the non-selection period. In this manner, a static 
charge is applied to the liquid crystal. The liquid crystal itself is the capacity loading type 
as well. When its time constant is sufficiently large compared to the frequency of the 
driving signal, the accumulation condenser can be omitted. The switching transistor can 
be a thin film transistor or MOS-FET (electric field effect transistor) formed on a silicon 
wafer, etc. 

In this invention, it is possible to form photoelectron transformation elements and 
switching elements in the same process. It is especially effective in method (3) above. 
However, this does not prevent its application to other methods. In addition, it can be 
applied to all display patterns such as characters, graphics, pictures, etc. 

Normally, color is synthesized from the three basic colors. In this step, 
interference filters which consist of inorganic or organic dye or pigment are used. The 
coloring step can be either outside or inside the substrate which constitutes the liquid 
crystal panel. In the case of the latter, it can be arranged either above or below the pixel 
electrodes or common electrodes. 

In the color liquid crystal panel, the incident light spectrum is only one of the 
three basic colors, and the remaining components are absorbed by the color filters. In 
addition, when the liquid crystal is activated by a polarizing plate, the amount of light 
used can be reduced even more so the screen will be very dark when used in the 
reflection mode which does not have lighting. Because of this, methods of backlighting 
the liquid crystal panel are used such as fluorescent lights, incandescent lamps, EL panels, 
or an EL panel. Ambient light may also be introduced to the back of the liquid crystal 
panel. If the device is intended to be portable, the power available is severely limited, 
and emission efficiency of the light source becomes an important point. 
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The color liquid crystal display panel with these features has photoelectron 
transformation elements such as photo diodes corresponding to each pixel. A light pen is 
run across the display screen, and light from the pen irradiates the inside of the panel and 
is received at the photoelectron transformation elements. Using this structure, a pattern 
which corresponds to the trace of the moving light pen is input and the liquid crystal 
display device can be used as a display and for input of information. Since this display 
device uses a liquid crystal panel, it is thin and light weight. At the same time, its power 
consumption is low. In addition, pattern information can be easily input since the 
photoelectron transformation elements correspond to each pixel. The position of the light 
pen with respect to the photoelectron transformation elements is determined by detecting 
signals from the photoelectron transformation elements which detect light from the light 
pen. A moving trace is detected by the photoelectron transformation elements in order. 
Pattern information can be input extremely fast and easily. 

(Example of practice) 

In the following, one example of practice of this invention is going to be 
explained in detail using figures. 

One side of a substrate which constitutes liquid crystal cells consists of TFT (thin 
film transistors) and photo diodes. Each TFT and photo diode (two terminal 
photoelectron transformation element) used in this example of practice corresponds to a 
pixel in the matrix. It is not necessary for the photo diode to be bonded or be a rectifying 
type. In this example of practice, TFT for driving the liquid crystal and the photo diode 
for detecting the light pen are formed on the substrate simultaneously by a single process. 
The photo diode has an excluding gate electrode and optical shield from the TFT. It is a 
photo conducting element which has the structure of electrode/semiconductor 
film/electrode. In order to determine which photo diode is receiving light from the light 
pen, one end of the photo diode is connected to the gate line of the TFT while other end is 
connected to a data line. Figure 1 is a top view of the TFT and photo diodes in the model. 
Figure 2 (A) is section A- A'; (B) is section B-B\ The TFT is made by forming and 
laminating a gate electrode (11), gate insulating film (12), semiconductor (13), source 
electrode (14), and drain electrode (15) in this order on a transparent insulating substrate 
(10) such as soda glass, quartz glass, plastic, ceramic, etc. The TFT correspond to each 
pixel electrode (16) in the matrix. A pixel electrode (16) and accumulating condenser 
when necessary are connected to the drain electrode (15). The gate electrode (11) which 
belongs to TFTs in the same line is connected to a common gate line (1 1)\ The source 
electrode (14) which belongs to TFTs in the same line is connected to a common data line 
(14)'. The gate line (11)' and date writing line (14)' are arranged in a matrix, and TFTs 
are formed corresponding to the crossing points. 

Photo diodes are formed by setting up a semiconductor film (13)' for detecting 
light between the gate line (11)' and date reading line (18) that are parallel to the data line 
(14) above. The photo diode may have one pair of parallel electrodes in the same plane 
as the TFTs. The space between electrodes is bridged by a semiconductor film. It is also 
possible that at least one side of the electrode is formed from a transparent conducting 
film and the semiconductor film is arranged between both electrodes. With the former 
case, both sides of the photo diode is sensitized to light from the TFT substrate. 
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However, the pixel density (effective area of pixel / total area of display section) becomes 
bad. In latter case, although only light from the transparent conducting film side can be 
detected, the gate and data wiring can be done effectively, and the pixel density can be 
higher. In this example of practice, an island of semiconductor film (13)' is set up on top 
of the gate line (11)' and a transparent conducting film (19) which consists of ITO (In 2 03 
+ SnOo) is applied, and one end is connected to the data line (18). The materials of the 
semiconductor film 13, 13' in the TFT and photo diode are selected from simple 
substances or mixtures of group IV elements group that have been doped when necessary 
(stochiometric compound, non-stochiometric compound, solid solution, alloy, etc.), 
simple substances, or mixtures of group VI elements. It could be a mono crystal, poly 
crystal, or amorphous. The semiconductor film (13)' for detecting light can be formed at 
the same time as the semiconductor film (13) of the TFT, or it can be formed from other 
materials. The thin film formation method may be vacuum vapor deposition, sputtering, 
CVD, plasma CVD, reduced-pressure CVD, etc. The pattern is formed by technology 
such as shadow mask or photolithography. 

In order to prevent erroneous activation due to ambient light, if necessary, an 
optical shield can be set up at the TFT section; and a filter is set up at the photo diode. 
The transmission spectrum of the filter on the photo diode corresponds to the emission 
spectrum of the light pen and has a narrow band width. Using such a filter guarantees 
that only light from the light pen is detected by the photo diode. In addition, an 
orientation film for orienting the liquid crystal is set up on top of that, and orienting 
strength is added by rubbing. 

The liquid crystal is driven by the TFT-photo diode substrate with the above 
construction by the following method based on line-order methods. When an n-type 
semiconductor (13)is used for the TFT, positive voltage is applied to the gate electrode 
(11), and a layer of electrons accumulates at the gate insulating film (12) side of the 
semiconductor film (13). Resistance between the source electrode (14) and drain 
electrode (15) is changed. Figure 3 is a block diagram that shows one example of 
practice of a driving circuit for this device. A scanning pulse is applied to the gate line 
(11)' periodically by a pulse circuit (3 1), and the TFT is turned ON. The picture image 
signal is scanning and stored in line memory (32) once. After that, it is applied to the 
data line (14)' at the same time as the scanning pulse. It is applied to the pixel electrodes 
(16) through the TFT and an accumulating condenser which is used when necessary. In 
accordance with the change of electric potential of the pixel electrode (16), the effective 
voltage applied to the liquid crystal is changed to drive the liquid crystal. Analog line 
memory (32)is used in order to display picture images containing intermediate tones. 
However, when intermediate tones are not necessary, digital line memory, that is, a shift 
register is used. The accumulating condenser is for retaining voltage to be applied to the 
liquid crystal even when the TFT is off. If the time constant of the liquid crystal is 
sufficiently greater than the scanning frequency, the accumulating condenser does not 
have to be used. 

The position of the light pen is detected by the photo diode as follows. The 
semiconductor film for detecting light (13)' has a small dark-conductivity and a high 
light-conductivity. When light is irradiated on the semiconductor film (13)' using the 
light pen, resistance is lowered. Then scanning pulse applied to the gate line (1 1)' is 
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transmitted to the data line (18). This pulse is detected by a comparator connected to 
each data line. Depending on where the pulse appears, the X coordinate is determined. 
The Y coordinate is determined by the timing of the pulse. This processing can be 
accomplished easily by a circuit such as the one shown in figure 4. The output of each 
comparator (41) is latched by a peak hold circuit or RS flip flop (42), and its output is 
introduced to an OR circuit (43). This output is reset to "0" at the beginning of each 
field, and when a photo diode which is receiving light from the light pen is scanned, it 
changes to "1". The Y coordinate is found by calculating the number of scanning pulses 
that occur during the time that the output of the OR circuit (43) is "0" according to the Y 
coordinate counter (44). With this procedure, even if light from the light pen is received 
by multiple photo diodes, only the highest level is detected. The X coordinate is 
determined by scanning output which is latched by a peak hold circuit or RS flip flop (42) 
during the vertical returning line period. If it cannot be processed during the vertical 
returning line period, the latched output is transferred to another shift register (45) once. 
During the next field, it is scanned using the TFT scanning pulse, and the number of 
clock pulses until the first "1" is found is calculated by an RS flip flop (42) and the X 
coordinate counter (46). These circuits can be external, or they can be arranged around 
the TFT substrate. In the latter case, it is possible to reduce the number of connection 
terminals of the TFT substrate and external circuit. When there is influence from ambient 
light, you can adjust the reference voltage Vref. of the comparator (41). 

Next, the counter electrode side of the cell substrate with the transparent 
conductive film and color filters is set up on a transparent substrate such as glass. The 
color filter and interference filter is made of inorganic or organic dye or pigment. For the 
color filter, three basic colors are arranged in stripes or in a mosaic by photolithography 
or printing methods. On top of this, a transparent conductive ITO film is applied by 
methods such as ion plating. On top of this, an orientation film for orienting the liquid 
crystal is set up. 

These two pieces of cell substrate are pasted together using a spacer, and liquid 
crystal is poured into the space between substrates, and a liquid crystal panel is 
manufactured. Furthermore, when the activation mode of the liquid crystal is TN, a 
polarizing plate is set up on both the front and back sides of the liquid crystal panel. 

The light pen is made by combining a that light source and lens. The light source 
may be an incandescent lamp with a filter, light-emitting diode, or a semiconductor laser. 
As stated above, it is better if the emission spectrum of the light source is narrow. The 
half width of the light-emitting diode can be about 10 to 100 nm. The light beam from the 
light source is output through a lens on one end of the light pen. Therefore, when the 
light pen is moved across the screen of the liquid crystal panei, light from the light pen 
reaches the photo diodes in the liquid crystal panel, and the trace of the light pen will be 
detected by the photo diodes. 

In addition, the above example of practice has been explained using TFT and 
photo diodes on a transparent substrate and the liquid crystal is a transmission type. As 
another example of this invention, transistors for driving the liquid crystal and 
photoelectron transformation element are applied to a semiconductor substrate such as Si, 
and the liquid crystal is a reflection type. 
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(Effects of this invention) 

A liquid crystal input-output device with the above construction is thin and light 
weight and has lower power consumption compared to prior input-output devices which 
use a CRT and light pen. It is suitable for portable electronic devices, and its technical 
advantages are huge. 

4. Simple explanation of figures 

Figure 1 top view of the TFT-photo diode substrate in one example of practice of this 
invention. 

Figure 2 (A) (B) are section A- A* and section B-B' of figure 1. 

Figure 3 is a block diagram for explaining the driving circuit of TFT. 

Figure 4 is a block diagram which shows one example of practice of a light pen position 

detecting circuit. 

10: insulating substrate 

1 1 : gate electrode 

IF: gate line 

12: gate insulating film 

13, 13': semiconductor film 

14: source electrode 

14': date line 

15: drain electrode 

16: pixel electrode 

18: data line 

19: transparent conducting film 

Assigned representative: Aihiko Fukushi, patent attorney (and 2 others) 
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